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Technical  Problem 

The  ARPA  Computer  Network  will  provide  communication 
paths  between  computers  distributed  across  the  United  States. 
The  ARPA  Contract  with  ^e  Network  Analysis  Corporation  In¬ 
volves  the  analysis  and  design  of  this  network  and  the  study 
of  properties  of  networks  of  this  type. 

During  the  reporting  period,  the  technical  problems 
considered  were  the  relationship  between  traffic,  routing, 
throughput  and  cost.  The  main  ^oblems  were  to  determine 
the  effect  of  routing  on  network  throughput  and  to  study  the 
properties  of  large  store-and-forward  networks. 

General  Methodology 

The  general  approach  to  the  above  problems  was  to  develop 
a  powerful  set  of  computer  programs  to  optimize  computer  net¬ 
work  cost  and  performance.  The  programs  were  used  to  derive 
estimates  of  optimum  performance  for  specified  networks,  amd 
to  derive  the  tradeoffs  between  cost  and  throughput  as  a  func- 
tlon  of  the  number  of  nodes'  in  the  network  under  consideration. 

Technical  Results 

A  number  of  Important  technical  results  were  derived 
during  the  reporting  period. 


1.  A  computer  program  that  can  find  optimal  routes  for 
all  traffic  was  developed.  The  program  was  used  to  derive 
upper  bounds  on  performance  and  it  was  shown  that  the  methods 
used  to  design  the  ARPA  Network  yield  near  optimal  results. 

2.  It  was  shown  that  the  performance  of  the  ARPA  Network 
is  highly  insensitive  to  input  traffic.  Therefore,  if  traffic 
forecasts  are  inaccurate,  the  network  will  retain  its  high 
throughput  capabilities. 

3.  Cost-throughput  relationships  were  derived  for  net¬ 
works  with  20,  40,  60,  60,  and  100  nodes.  It  was  shown  that 
large  networks  are  economical  to  operate  using  the  present 
technology  of  the  ARPA  Network. 

Department  of  Defense  Implications 

The  substantial  cost  advantages  of  computer-communication 
networks  with  as  many  as  100  nodes  was  demonstrated.  This 
property  is  of  particular  importance  in  satisfying  the  Defense 
Department's  computer  and  communication  requirements.  The 
technical  results  imply  that  large  computer  networks  can 
supply  rapid  and  economical  means  for  resource  sharing  and 
communications. 

Implications  for  Further  Research 

The  use  of  equipment  presently  being  developed  and  com¬ 
munication  line  options  not  yet  available  may  further  enhance 


the  economy  of  large  store-and-forward  networks.  This  area 
should  be  pursued  since  by  using  the  network  optimisation  approach, 
it  may  be  possible  to  suggest  the  most  efficient  equipment  to 
develop. 
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OPTIMAL  ROUTING 


The  efficiency  of  any  network  design  depends  crucially 
on  the  routing  procedures  used  In  generating  and  operating  the  net¬ 
work.  Efficient  design  techniques  Involve  the  repeated  analysis* 
transformation  and  reanalysls  of  proposed  starting  networks.  Hence* 
the  cost  required  to  apply  a  given  routing  procedure  Is  a  limiting 
factor  on  the  potential  range  of  applicable  transfor{natlons  and 
hence*  the  economy  of  the  final  network  design.  Therefore*  network 
optimization  requires  a  compromise  between  the  effectiveness  and 
computational  complexity  of  the  routing  procedure. 

The  basic  routing  procedure  employed  for  examining  the 
cost-throughput  characteristic  of  large  networks  and  In  optimizing 
the  ARPA  Network  was  described  In  References  [1]  and  [2]  and  Is 
summarized  In  Section  2..  This  suboptlmal  procedure*  called 
Minimum  Link  Traffic  Routing*  has  the  advantage  that  It  Is  In¬ 
expensive  to  use  amd  gives  better  performance  than  a  number  of  other 
practical  routing  schemes  as  Indicated  by  simulation  models  [3] . 

On  the  other  hand*  there  has  been  no  clear  picture  of  the  per¬ 
formance  losses  generated  by  non  optimal  routing  procedures. 

In  this  section*  we  discuss  a  procedure  for  optimally 
routing  traffic  through  a  fixed  network  whose  lines  have  been 
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assigned  fixed  capacities.  O^e  procedure  is  capable  of  deteznining 

the  traffic  flow  pattern  which  minimizes  average  time  delay.  It  is 

shown  that  the  routixig  problem  can  be  formulated  as  a  variation  of 

the  classical  "multicommodity  flow"  problem,  whose  computational 

complexity  depends  mainly  on  the  number  of  nodes  and  links  within 

the  network.  Examples  of  networks  with  twelve  and  eighteen  nodes 

are  examined  and  the  results  of  optimal  routing  compared  with  the 

suboptimum  procedures  used  in  [1]  and  [2]  and  in  the  other  parts 

of  this  report. 

Problem  Formulation 

in  a  standard  multi-commodity  flow  problem  [4] ,  a  source 
is  a  node  from  vfhich  commodities  are  originated  and  a  terminal  is 
a  node  to  which  commodities  are  destined,  ^e  multicommodity  prob¬ 
lem  consists  of  finding  a  flow  pattern  that  either  maximizes  the 
amount  of  commodities  delivered  to  the  terminals  or  delivers 
specified  amounts  of  commodities  with  least  cost.  In  the  latter 
case,  cost  is  usually  computed  as  the  sum  of  constemt  cost  factors 
for  tremsporting  each  commodity  through  each  link  times  the  amount 
of  commodity  so  transported. 

The  c<munodities  are  packets  of  data  to  be  transmitted 

through  the  network.  Each  node  is  a  terminal  as  well  as  a  source. 

Element  r  in  the  traffic  requirement  matrix  R  can  be  viewed 
k,i 
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as  the  amount  of  commodity  1  whi^  is  supplied  from  node  k 
destined  for  node  i.  All  traffic  destined  for  i  can  be  viewed  as 
commodity  i.  There  are  then  N  commodities  where  N  is  the  number 
of  nodes  in  the  network.  Each  node  demands  exactly  one  distinct 
commodity  and  supplies  N-1  others.  We  want  to  route  the  traffic 
such  that  the  average  delay  time  (which  corresponds  to  the  cost 
function)  is  minimized  emd  each  branch  flow  is  less  them  the 
corresponding  branch  capacity.  The  average  delay  time  is  a  non¬ 
linear  function  and  consequently,  we  must  solve  a  problem  con¬ 
siderably  more  difficult  than  the  classical  multicommodity  flow 
problem. 


The  model  for  time  delay  analysis  has  been  deiscribed 
in  [1]  cuid  [2]  and  will  not  be  repeated  here.  Delay  time  is 
affected  by  both  node  and  branch  limitations,  ^e  effect  of  node 
limitations  is  small  until  the  network  approaches  saturation 
[1,  2].  In  order  to  obtain  tractable  results,  node  limitation 
effects  were  omitted  from  the  network  routing  model.  This  was 
justified  on  the  following  basis: 

(1)  Past  experience  has  shown  that  node  limitations 
play  a  minor  role  at  the  traffic  levels  under  consideration.  The 
reason  for  this  is  that  for  the  ARPA  Network,  the  IMP  buffers  are 
capable  of  handling  the  req[ulred  traffic. 
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(2)  It  can  be  ahoim  that  ainimislng  avaraga  tina  dalay  tanda 
to  mlnimisa  tha  affact  of  noda  limitatlona  as  conputad  by  KAC'a 
tima  dalay  analyala  program.  Tha  multicommodity  routing  problem 
can  than  ba  formulated  as  tha  following  iiaparabla  convex  [4]  pro¬ 
gramming  problem  t 
Minimise 
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where 

^HOST  average  dalay  tima  on  HOST-IMP  line  for  an 

packet 

T  is  tha  aatimatad  IMP  processing  tima  for  an  average  packet 
INP 

M  is  the  nxsnber  of  links  (each  physical  link  is  represented  by 
two  oppositely  directed  links) 

N  is  the  number  of  nodes  (IMPs) 

r  is  tha  total  iMP-to-IMP  throughput,  RFNM,  header,  and 
parity  Ohapk  include^ 


(3) 

average 
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1^* 


A 


is  tho  capacity  of  link  i 

ia  the  average  short  meeeage  length 
is  the  average  packet  length  in  the  system  including 
long  messages,  RFNM,  header,  and  parity  dhedk 
is  the  packet  length  of  an  acknowledgment 

is  the  length  of  link  i  in  miles 

is  the  incidence  matrix  of  the  network. 

That  is,  a  ■  1  if  link  j  is  directed  out  of  node  i, 

3 

a  .  ■  -*1  if  link  j  is  directed  into  node  i  and 

3 

a  ■  0  if  link  j  is  not  incident  at  node  i. 

3 

is  the  flow  in  link  i 

is  the  portion  of  the  traffic  on  link  j  that  is  destined 
for  node  i 

is  the  transpose  of  the  vector  (f.  ,,  f.  ,,  •••  , 

Xe  X  Xe  2 
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•  •  •  * 


f 

r.  . 


r 

i.j 


is  the  transpose  of  (f  ,  f  ,  •••  ,  f  )• 

X  2  M 

is  the  negative  of  the  total  traffic  destined  for 
(or  required  at)  node  i. 

for  i  j  is  the  traffic  ge}».irated  at  node  j  with  final 
destination  node  i. 
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jr  is  tlM  trsBsposs  of  ths  voetor  (r.  ,«  •  •••«  r.  •••« 

1  1,2  i#3 

£  is  ths  transposs  of  ths  vsetor  (C]^«  C2#  •••«  C||). 

in  ths  ebjoetivo  funetion,  ths  first  tsm  in  ths  brsckst  is 
ths  svsrsgs  wsitiag  tisM  snd  ths  ssoond  tsm  is  ths  svsrsgs 
trsasaissiOB  tisM  rsqiaixsd  for  s  short  nssssgs  to  trsvsl  scross 
link  if  ths  third  tsm  is  tlvi  propagation  tins  on  tl)st  link. 

Ihs  factor  (1  */**/A^  u)  ^  eonpsnsats  for  ths  sxtra 

■OIC 

traffio  dtts  to  soknowlsdgMnts.  (ihis  eoavsnsation  approach  is 

only  appliosbls  with  a  symstrie  traffic  natrix  as  is  our  eass)  • 

« 

Ihs  objsetivs  funotion  is  oonvsx  aa  is  sasily  sssn  hy  rswriting 

it  as 

M  r 


Whsrs  f^^.has  rsplaosd  (1  ■»  and  rhis  rsplacsd 

Thus,  it  ean  bs  approBcisuitsd  with  arbitrary  aceuraoy  by  a  monotonic. 

piscswios  linsar  oontinuous  funotion  of  ths  |f^j  •  ihs  accuracy 

of  ths  approKiauition  is  dstsminsd  by  ths  nunbsr  of  lins  ssgmsnts 

used. 

constraint  (1)  is  oallsd  ths  oonssrvation  constraint  and 
rsprsaants  ths  rsquirmant  that  ths  flow  into  ai^  dip  is  equal  to 
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the  flow  out  of  any  IMP.  The  second  constraint  merely  indicates 
that  the  flow  in  any  link  is  equal  to  the  sum  of  all  commodities 
in  that  link.  Constraint  (3)  restricts  the  traffic  on  any  link 
to  be  no  greater  than  the  corresponding  link  capacity. 

If  the  objective  function  is  approximated  by  a  piecewise 
linear  one,  the  routing  problem  can  be  solved  as  a  linear  program. 
Then,  the  limitation  to  the  solution  of  specified  routing  problem 
is  its  size  and  computational  complexity. 

The  number  of  constraints  in  the  linear  program  is  in  part 
a  function  of  the  accuracy  with  Which  the  objective  function  is 
approximated.  If  P  linear  segments  are  used  in  the  approximation, 
then  the  program  has  -t*  3M  constraints  and  (N  P  1)M  variables. 

^e  desired  output  is  a  curve  indicating  the  relationship 
between  time  delay  and  input  traffic.  The  linear  program  formulated 
above  will  produce  one  value  of  the  objective  function  (minimum 
delay)  for  a  specified  value  of  input  traffic.  Because  of  the  large 
fixed  overhead  involved  in  setting  up  and  .finding  an  initial  feasible 
solution  for  the  linear  program,  the  cost  of  generating  a  curve  by 
repetitive  application  of  a  linear  programming  algorithm  would  be 
prohibitive  on  a  point  by  point  basis.  Instead,  a  parametric 
approach  can  be  used.  Constraint  (1)  is  written  as 
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A  f  ■  r  +  6  r  for  i“l,  2,  ...  ,  N 
i  "i  “i 

Initially,  8  »  0.  Ihe  linear  program  is  solved  and  the  basis  for 

the  optimal  solution  retained.  The  value  of  8  is  then  increased. 

This,  in  effect,  increases  the  specified  traffic  matrix.  The 

parameter  6  is  continuously  increased  until  a  basis  change  is 

required  for  a  new  feasible  solution.  A  new  optimal  solution  is 

then  found  by  generating  a  feasible  solution  by  starting  from  the 

basis  of  the  previous  optimal  solution.  The  process  terminates 

when  0  reaches  a  preset  upper  limit  or  when  feasible  solutions  can 

no  longer  be  found  for  higher  values  of  G  .  The  effect  of  the 

parameterization  is  to  generate  the  entire  curve  relating  time 

delay  to  traffic  at  a  substant.ially  reduced  cost. 

Examples 

Several  examples  of  the  problem  were  solved  in  the 
above  manner.  In  addition  to  conputing  the  minimum  time  delay 
for  each  traffic-matrix,  the  paths  found  by  the  program  in  gene¬ 
rating  this  time  delay  were  recorded.  These  paths  were  then 
compared  with  those  found  by  Minimum  Link-Traffic  Routing.  In 
addition,  time  delays  for  both  routing  procedures  were  compared. 
From  these  examples,  the  following  results  were  found: 

(1)  The  Minimvun  Link  Traffic  Routing  algorithm  is 
only  slightly  Inferior  to  the  theoretically 
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best  routing  procedure  especially  in 
high  traffic  situations; 

(2)  Although  an  optimal  routing  can  use  many 
paths  to  satisfy  the  flow  requirement 
between  any  padr  of  nodes,  in  the  solutions 
examined  thus  far  a  single  path  between 
most  pairs  of  nodes  is  used; 

(3)  Most  routes  picked  by  the  optimal  routing 
are  the  same  as  those  determined  by  the 
Minimum  Link  Traffic  Routing; 

(4)  While  the  Minimum  Link  Traffic  Routing  uses 
the  same  routes  regardless  of  the  traffic 
level,  routes  picked  by  the  optimal  routing 
vary  somewhat  with  the  traffic  level. 

One  network  considered  is  shown  in  Figure  1.1.  A  uniform 
traffic  matrix  was  used.  The  network's  adjacency  matrix  and  capacity 
matrix  are  given  in  Table  1.1.  The  fifth  row  of  Table  1.1a  indicates 
that  node  5  is  connected  to  node  7'  and  node  9.  ^e  fifth  row  of 
Table  1.1b  indicates  that  the  capacity  of  the  branch  connecting  node 
5  and  node  7  is  230,400  bits/sec,  emd  the  capacity  of  the  branch 
connecting  node  5  and  node  9  is  50,000  bits/sec.  Other  rows  in  this 
table  can  be  interpreted  in  the  same  way.  The  average  delay  times 
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arising  from  different  traffic  levels  are  shown  in  Table  1.2  and 
1.3  and  plotted  in  Figure  1.2.  Table  1.4  shows  the  routes  adopted 
by  the  Minimum  Link  Traffic  Routing  algorithm.  For  example,  row  3 
under  source  node  1  means  that  the  route  from  node  1  to  node  5  is 
via  node  3  and  node  7.  Other  routes  can  be  interpreted  similarly. 
Table  1.5  shows  the  routes  selected  for  the  optimal  routing  for  the 
traffic  at  6650  bits/node.  The  rows  with  asterisks  are  the  routes 
that  differ  from  those  indicated  in  Table  1.4.  Finally,  Tables  1.6 
and  1.7  show  the  link  traffic  for  the  optimal  routing  at  6500 
bits/sec/node  and  at  8120  bits/sec/node,  respectively.  As  an  ex¬ 
ample  of  the  interpretation  of  these  tables,  in  Table  1.6  the  first 
row  indicates  that  the  link  connecting  node  2  and  node  1  has  a 
total  traffic  of  2000  bits/sec  of  which  1000  bits/sec  is  bound  for 
node  1  and  1000  bits/sec  is  bound  for  node  3. 

^e  18  node  network  shown  in  Figure  1.3  was  also  con¬ 
sidered  with  both  Minimum  Link  Traffic  routing  and  optimal  routing 
with  uniform  traffic.  Its  adjacency  and  capacity  matrices  are 
given  in  Table  1.8.  Results  aure  shown  in  Figure  1.4  and  Tables 
1.9  -  1.13: 


The  above  examples  indicate  that  the  Minimum  Link  Traffic 
Routing  is  very  effective  under  uniform  traffic  condition.  However, 
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since  the  networks  used  were  qinally  de.'^igned  using  essentially 
uniform  traffic  assumptions.  It  may  be  possible  that  they  are 
biased  so  that  the  Minimum  Link  Traffic  Routing  will  give  near 
optimum  routing  when  uni form -traffic  is  applied.  We  therefore 
examine  the  same  networks  with  randomly  generated  traffic  matrices. 

A  vector  of  N(N  -  l)/2  uniformly  random  integers  is  generated  and 
the  element  r.  .of  the  traffic  matrix  R  set  equal  to  'the 

[  - ^2  element  in  the  vector  multiplied  by 

K  for  i>  j,  and  to  be  r ,  .  if  i<j.  Here,  K  is  a  constauit  whose 
value  determines  the  proper  traffic  level.  In  the  12  node  network, 

K  «  ISO  to  give  an  initial  traffic  of  approximately  5  kilobits/sec/node. 
In  the  18  node  network,  K  «  161  to  give  a  starting  traffic  of  approxi¬ 
mately  10  kilobits/sec/node. 

Time  delays  using  both  the  optimum  ^u^d  suboptimum  procedures 
can  then  be  generated  in  the  same  manner  as  before.  The  new  delays 
indicate  that  the  networks  are  not  uniform  traffic  biased.  The 
relative  performance  of  the  Minimum  Link  Traffic  Routing  in  compari¬ 
son  with  Optimal  Routing  under  random  traffic  condition  is  as  good  as 
that  under  the  uniform  traffic  condition,  (it  is  also  interesting  to 
note  that,  with  the  same  routing  procedure,  the  throughput  under  the 
random  traffic  is  10%  higher  in  one  case  ^u^d  10%  lower  in  the  other. 
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Tliis  shows  that  the  networks  will  operate  properly  with  a  non> 


uniform  traffic  matrix,,  even  though  they  were  originally  designed 
under  uniform  traffic) .  The  delays  for  the  12  node  network  with 
random  traffic  are  shown  in  Figure  1.5«  and  Tables  1.14  and  1.15. 

Finally,  in  Section  2,  the  results  of  a  combination  of  simula¬ 
tion  and  analysis  to  determine  the  sensitivity  of  network  perfor¬ 
mance  to  the  traffic  distribution  is  discussed. 


HIGH  THROUGHPUT  12  NODE  NETWORl 

THE  12  NODE  NETWORK 
USED  FOR  ROUTING 
COMPARISON 


FIGURE  1.1 


TABLE  1.1 


ADJACENCY  MATRIX 


1- 

2- 


3- 

4- 

5- 

6- 

7- 

8- 
9- 

10- 

11- 

12- 


2  3  4 

1  4 

1  7 

2  17 

7  9 

8  11 

3  5  4 

6  10  12 

5  11  12 

8  11 

4  6  9 

8  9 


11 


10 


(a) 


CAPACITY  MATRIX 


1- 

50000 

50000 

50000 

2- 

50000 

50000 

3- 

50000 

50000 

4- 

50000 

50000 

50000 

108000 

5- 

230400 

50000 

6- 

230400 

50000 

7- 

50000 

230400 

50000 

8- 

230400 

230400 

230400 

9- 

50000 

50000 

50000 

10- 

230400 

50000 

11- 

1080P0 

50000 

50000 

50000 

12- 

230400 

50000 

(b) 
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TABLE  1.2 


TIME  DELAY  ANALYSIS  -  MINIMUM  LINK  TRAFFIC  ROUTING 


Average  No.  Bits/Sec/Node 

5500 

1 

.0502 

6600 

.0512 

7700 

.0522 

8800 

.0534 

9900 

.0546 

11000 

.0561 

12100 

.0577 

13200 

.0595 

14300 

.0617 

15400 

.0642 

16500 

.0672 

17600 

.0708 

18700 

.0755 

19800 

.0816 

20900 

.0903 

22000  - 

.1044 

23100 

.1352 

23650 

.1810 

24200  .  ' 

1.7489 

1.15 


TABLE  1.3 


TIME  DELAY  ANALYSIS  -  OPTIMAL  ROUTING 


Averacre  No.  Bits/Sec/Node 

Delay  (Sec) 

6500 

0.0408 

8120 

0.0437 

9730 

0.0450 

» 

11400 

0.0473 

13000 

0.0485 

14400 

0.0506 

16250 

0.0540 

18000 

0.0576 

19450 

0.0640 

21250 

0.0700 

22750 

0.0810 

23600 

0.1197 

24000 

0.1420 

1.16 


TABLE  1.4 


MINIMUM  LINK  TRAFFIC  ROUTES 
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3  7  5  • 
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3  1  4  11  10 

3  7  5  9  12 

3  7  5  9  12  8 
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2  13 

2  4  7 

2  4  11 

2  4  7  5 

2  4  11  6 

2  4  11  9 

2  4  11  10 

2  4  11  6  8 

2  4  11  9  12 

Source  Node  4 

4  7  3 

4  7  5 

4  11  6 

4  11  9 

4  11  10 

4  11  6  8 

4  11  9  12 
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TABLE  1.5 


OPTIMAL  ROUTES 

Average  No.  Bits/Sec/Node  =  6650 
Average  Delay  =  0.0408 


Source  Node  1 

13  7 

1  4  11 

13  7  5 

1  4  11  6 

1  4  11  9 

1  4  ' 11  10 

1  4  11  6  8 
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Source  Node  3 
3  12 

3  7  4 

3  7  5 
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*  5  7  4  11  10 


6  11  4 

*6  8  12  9 

6  8  10 

6  8  12 

6  11  4  1 

6  11  4  2 

*  6  8  12  9  5 

6  11  4  7 

6  11  4  1  3 


1.22 
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EXAMPLE  OF  LINK  TRAFFIC  IN  THE  OPTIMM.  ROUTING 
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EXAMPLE  OF  LINK  TRAFFIC  IN  THE  OPTIMAL  ROUTTNfl 
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TABLE  1.8 
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1 

5 

6 
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4 

7 
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5 
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16 
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4 
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1 

5 

6 

8 

2 

16 

5 

6 

1 

2 

4 

9 

2 

4 
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1 

5 

6 
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2 
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1 
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13 
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1 
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1 

5 

6 
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6 
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4 

4 

2 

1 

3 
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5 

4 

2 
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3 
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16 
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5 
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14 

3 

1 

5 
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16 

3 

2 

4 
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• 
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OPTIMAL  ROUTES 
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9  4  2  1 

9  4  2  3 
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9  14  8  12 
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9  4  1  16 
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*  9  14  8  6  10  13 


1.34 
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Averacre  No.  Bits/Sec/Node 

BUM 

1:2750 

.0745 

13387 

.0771 

14025 

.0801 

14662 
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1.36 


1  > 

1 

, 

i 

<» 

b 

h 

f 

a 

•y 

;  '  ' 

.  M ; 

IJ 

u 

ii 

1) 

0 

0 

0 

^ .  1  ) 

'  \  k  * 

1  .'■111 

0 

l) 

IJ 

1000 

1000 

10  0  0 

.  n 

\  i  >  !  ■ 

.  !  ■)  il 

ij 

.■./■J 

0 

0 

0 

0 

0 

1 .  ') 

/ 

1  } 

1 1 1 J  u 

u 

1 110  0 

0 

0 

0 

0 

100 

< .  ' ) 

'  •  i 

.. 

1 0'.'i 

J 

1  0  0  0 

.)dl 

0 

0 

0 

100 

• .  ’ ) 

■ )  C‘  V 

■■>  1'  i)  u 

•i 

1) 

0 

1) 

0 

1-.  ’) 

1  ■' 

1  ■  .. 

1  U  n  W 

T'.-’l 

looo 

0 

0 

0 

Q 

100 

!  . 

\i 

'■t  /<-! 

0 

0 

0 

0 

0 

.  ■  .  ■  ) 

.■ .  1 

■J 

/■j/.  1 

0 

0 

0 

u 

0 

’  .  ■ ) 

‘  1 

0 

u 

‘JOUO 

0 

0 

0 

0 

400 

!  ^  ) 

1  •  ■ . : 

O 

u 

u 

/  0  0  0 

0 

0 

0 

0 

200 

.  •  ) 

i 

'} 

'Mu'j 

'  0  0  0 

fj  0  0  0 

i04d 

0 

dOOO 

0 

!  /  .  O 

r  ,  . 

IJ  v.)'ii 

iJ  Oli 

■f  OOO 

dOOO 

0 

dOOO 

0 

200 

1  .  . ) 

i  /  .  /  ■ ' 

■J 

ij 

0 

0 

10 /V 

dOOO 

dOOO 

dooo 

^  %  ..  ) 

■f  /  ■  •  :  ■*. 

/  J  J  0 

/  0  '.1  (j 

/UOl) 

-jOOU 

.  0 

^000 

0 

/  .  .  ) 

•'  1  :  • 

1  ')UU 

1  u  0  0 

1 0  U 

0 

b  0  4  (? 

dOOO 

0 

dooo 

!  -  . 

1  • 

I.J 

0 

0 

0 

dbdl 

dOOO 

dOOO 

2000 

) 

'.J 

u 

0 

0 

0 

iTOOO 

0 

70  00 

-  .  1 

't  Vt  1  / 

1  ./v 

•■f.)  J'U 

‘*000 

cOOO 

4  Ob  a 

aooo 

4000 

0 

1  r.  .  ) 

^  ,-.n 

.. ''  1 

'J  C  IJ 

,'1"J0  0 

*iOOO 

dOOO 

^:000 

dOOO 

2000 

20C 

.  n 

1 

U 

0 

0 

0 

4  04d  .. 

1.0  00 

bOOO 

1000 

^ .  / ) 

1  i-,r‘ 

0 

11 

0 

bOOO 

0 

0 

idooo 

0 

IOC 

*'  •  ■  ) 

“  r  1  / 

0 

0 

0 

0 

0 

0 

0 

10000 

30  ( 

1  ^ .  '. ) 

1:. 

•i  7'J 

1 

1  000 

iOOO 

dooo 

dOOO 

lOUO 

2000 

20( 

1  ■  • .  ^  1 

1  1  1 

a 

u 

0 

0 

..9ba 

dOOO 

. 0 

..  2000 

1  ■'  ,  :  ) 

1  >  ) 

-i’tO'J 

‘->000 

0 

10  00 

3000 

dOOO 

3000 

10( 

1 

1:. 

0 

u 

(J 

0 

0 

0 

0 

.  0 

90( 

]  /. .  n 

lilt/' 

1 1 1  tj  ij 

1000 

I  000 

1000 

-  -4d 

. 0 

1000 

0 

aoi 

^ .  m 

1 

0 

0 

u 

-  0 

- ,  0  . 

. .  .0 

. . .  0. 

. .  0  . 

r< .  n ) 

1  '  1 

1  ifil 

1  'J  U  0 

1  0  0  0 

1000 

1000 

looo 

1000 

1000 

ib( 

I  > .  n  ) 

i  ^ 

0 

0 

.  .  0 

. 0., 

_ .0-... 

_ 0... 

. . 

0  . 

M.  1  l  1 

1  A 

0 

0 

0 

0 

0 

0 

. . 0 

0 

'  •  i  ?  1 

1;: 

0 

u 

0 

0 

0 

0.. 

0 

0 

l  u  1  :■’ ) 

1 

!) 

^^£^ 

0 

0 

1000 

1000 

0 

1000 

lOi 

1  i .  1’ ) 

fjAl 

0 

0 

0 

..  0 

.  0  .... 

0 

0. 

0 

1  '.in 

1-.  )  - 1 

ij 

0 

0 

0 

.  0 

0 

0 

0 

!  ■  1  ;  1 

jrll 

0 

0 

0 

0 

0 

0 

0 

.  1  n 

L  .•  ^ 

0 

(J 

0 

0 

0 

0 

0 

0 

70 

''■!•) 

i  ■■:  ..  ^  '■/ 

(J 

0 

0 

0 

0 

1000 

0 

1000 

.  1  ) 

/  j  ' 

'0 

0 

0 

0 

0 

0 

0 

0 

!  !  •  l  . ) 

t  - 1 , 

1 1/  j'.l 

>  ro 

1  OOO 

1  0  C  0 

.0 

_ 0_ 

10  00 

0 

1  .  1  . ) 

\  7  j  ■  i; 

t) 

U 

0 

0 

0 

dOOO 

0 

2000 

/'  .  1  ■.  1 

i  f  '1 

Ij 

u 

0 

0 

Ibdl 

1000 

1000 

1000 

'.!■.) 

1  ■-  1 

■J 

<  0  L'  U 

bitl 

0 

0 

0 

0 

0 

1  '  ;  1 

U 

0 

0 

0 

0 

0 

0 

r  .  1  ,' ) 

1  •  .  , 

1  0 

1  iJ  0  U 

1000 

30  00 

looo 

0 

1000 

0 

10 

1  ■  .  1  ■ ) 

17.:., 

ft 

iJ 

0 

do  00 

0 

0 

0 

0 

1  /•.  1  ■ ) 

1  i 

IJ 

u 

0 

0 

0 

1000 

0 

1000 

0 

1 

0 

•y 

10 

1 1 

12 

1  i 

14 

15 

16 

1  f 

18 

u 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1000 

1000 

1000 

0 

1000 

1000 

1000 

Itjfjo 

1) 

1  0  0  0 

0 

0 

n 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1  000 

0 

0 

0 

0 

1000 

0 

1  0  0  0 

1  0  0  0 

1 IJOO 

0 

0 

0 

1000 

0 

0 

0 

0 

1  0  0  0 

0 

1  0 :)  0 

1  0  0 ') 

1  0  0  0 

.  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0  0 

IJ 

0 

0 

0 

0 

1000 

0 

0 

0 

u 

1  0  0 1) 

0 

G 

1  0  ■;  0 

1  0  0  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

u 

0 

0 

0 

0 

.  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

4000 

0 

0 

0 

0 

0 

0 

0 

4  0  <J  0 

'♦0  0  0 

0  . 

0 

0 

2000 

0 

0 

0 

0 

1042 

0 

0 

20  0  0 

?0‘)0 

0 

2.00  0 

0 

0 

0 

0 

0 

0 

0 

0 

2  G  0  0 

2  0  0  0 

1000 

0 

2000 

0 

2000 

0 

0 

0 

0 

moo 

0 

2  0  00 

0 

0 

^QQ0 

2000 

2000 

0 

2000 

2000 

2000 

2000 

0 

2000 

0 

0 

0 

. . 0.. 

YOOO 

.  0 

0 

0 

0 

0 

0 

0 

0 

70  00 

0 

0 

£000 

0 

2000 

0 

2000 

1000 

2000 

2000 

0 

1000 

1000 

0 

0 

£000 

2000 

2000 

0 

2000 

2000 

2000 

2000 

0 

2000 

0 

0 

0 

7000 

0 

7000 

0 

7000 

6000 

7000 

7000 

958 

6000 

0 

0 

0 

dOOO... 

.  4000 

.  0 

. 0  .. 

6000 

0 

0 

.3000 

0 

0 

4  0  0  0 

0 

0 

_,£000 

2000 

2000 

2000 

0. 

0 

0 

0 

2000 

1000 

2000 

1000 

10  0  0 

1000 

5000 

1000 

0 

1000 

0 

1000 

1000 

0 

0 

0 

0 

0 

.0.. 

12000 

0 

1000 

0 

0 

0 

0 

42 

0 

0 

1000 

1000 

0 

0 

10000 

3000 

0 

64  79 

8000 

0 

3958 

800  0 

0 

2000 

2000 

£000 

1000 

2000 

2000 

0 

0 

. 0 

0 

.2000 

0 

2000 

0 

0 

2000.. 

0. 

2000 

. . 0  .. 

2000 

.2000 . 

...2000 

2000 

0 

2000 

0 

0 

1000 

3000 

2000 

..  3000 

1000 

3000 

0 

0 

0 

2000 

0 

1000 

0 

0 

....  0.. 

. 0 

_  0 

9000 

....  0 

0 

. .  .0... 

0 

7042 

0 

0 

0 

0 

_ 0 

1000 

0 

dOOO 

.  Q 

.  0 

0 

.  0. 

..  .  0 

0 

1000 

1000 

0 

_ 0 

_ .0. 

_ _ 0. 

. . 0 

14000 

521. 

.  0 

11000 

0 

0 

0 

0 

0 

1.000. 

-  1000 

_  1000 

1000. 

3000 

..._.o.. 

. . _0 

0 

1000 

0 

1000 

0 

0 

. . 0... 

. . Q.. 

. _..0 

......_ . 0... 

. 0 

9042 

_.  0 

0 

0 

2000 

0 

2000 

2000 

. . 0 . 

. . 0. 

0 

0 

0 

7958 

3000 

3000 

0 

0 

0 

0 

0 

.  0.. 

0 

0 

0 

.0 

5521 

llOOO 

0 

0 

0 

0 

0 

0 

1000 

0 

1000 

1000 

1000 .. 

0 

4000 

4000 

1000 

0 

1000 

0 

0 

. .....0.... 

. ...0.. 

0 

0 

0 

2521 

2000 

0 

0 

1000 

0 

1000 

1000 

. . 0 

0 

0 

.  0 

0 

1521 

1000 

12000 

0 

0 

0 

0 

0 

...  0 

0 

0 

0 

2000 

0 

0 

5000 

0 

0 

0 

0 

0 

0 

0 

0 

7000 

0 

0 

0 

0 

8958 

0 

0 

0 

0 

1000 

0 

1000 

0 

1000 

1000 

1000 

1000 

8042 

1000 

0 

0 

0 

0 

0 

0 

0 

0 

3958 

0 

0 

0 

11000 

0 

3000 

4000 

0 

1000 

0 

0 

0 

0 

0 

0 

0 

3000 

0 

3000 

30  0  0 

2000 

. 0 

.2000 

0 

2000 

3000 

2000 

2000 

lOOo 

3000 

0 

0 

0 

1000 

1000 

1000 

0 

1000 

1000 

1000 

1000 

0 

1000 

30  00 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

■>000 

0 

0 

.  0  . 

.  .0 

0 

0 

0 

1000 

0 

0 

0 

1000 

0 

9000 

80  00 

0 

1000 

0 

1000 

0 

0 

0 

0 

0 

0 

1000 

800  0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

/ooo 

80  0  0 

1000 

0 

1000 

0 

1000 

2000 

1000 

1000 

0 

2000 

0 

0 

90  00 

I'XAMPLI':  OP  DIV^NCII  TlV^FFIC  IN  TUB  OPTIMAL  ROUTING 
Avcrago  No.  Bits/Scc/Node  »  12950 
Average  Delay  Time  «  0.0700 


1.37 


TABLE  1.14 


TIME  DELAY  ANALYSIS  ■  MINIMUM  LINK  TRAFFIC  ROUTING 
(12  nodes^  random  traffic) 


Averaae  No.  Bits/Sec/Node 

Delay  (Sec) 

8582 

.0502 

10601 

.0522 

11106 

.0527 

12621 

.0546 

13630 

.0560 

15145 

.0585 

17669 

.0640 

20193 

.0723 

21203 

.0770 

22212 

.0830 

23222 

.0910 

24232 

.1025 

25241 

.1207 

26251 

.1573 

26756 

.2009 

27261 

.4343 

1.39 


TABLE  1.15 


TIME  DELAY  ANALYSIS  -  OPTIMAL  ROUTING 


(12  nodes^  random  traffic) 


Averaae  No.  Blts/Sec/Node 

Delay  (Sec' 

5467 

• 

0.0476 

6490 

0.0484 

7031 

0.0487 

11402 

0.0525 

15986 

0.0591 

..0031 

0.0693 

22500 

0.0798 

24495 

0.0962 

25084 

0.1020 

27750 

0.1500 

1.40 
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MINIMITM  LINK  TRAFFIC  ROUTING 


The  routing  procedure  is  determined  by  the  assiunption  that 
for  each  message  a  path  which  contains  the  fewest  number  of  inter¬ 
mediate  nodes  from  origin  to  destination  is  most  desirable. 

Basic  Algorithm 

Given  a  proposed  network  configuration  and  its  required 
traffic  matrix*  routes  are  determined  as  follows:  For  each  1 
(i“  If  2f  •#.  f  N): 

1.  With  node  i  as  an  initial  node*  use  a  labelling  pro¬ 
cedure  to  generate  all  paths  containing  the  fewest  number  of 
intermediate  nodes*  to  all  nodes  which  have  non-zero  traffic  from 
node  i.  Such  paths  are  called  feasible  paths. 

2.  If  node  i  has  non-zero  traffic  to  node  j  (j  ■  1*  2* 

•  ••  #  N*  j  i)  &nd  the  feasible  paths  from  i  to  j  contain  more 
than  NMAX  nodes*  (NNMC  is  a  fixed  nuniber)  the  topology  is  gon- 
sidered  infeasible. 

3.  Nodes  are  grouped  as  follows: 

(a)  All  nodes  connected  to  node  i. 
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(b)  All  nodes  connected  to  node  i  by  a 
feasible  path  with  one  intermediate  node. 

(c)  All  nodes  connected  to  node  i  by  a 
feasible  path  with  two  intermediate  nodes. 

(d)  . . 

(e)  . 

(f)  All  nodes  connected  to  node  i  by  a' 
feasible  path  with  UMAX  -  2  intermediate 
nodes . 

Traffic  is  first  routed  from  node  i  to  any  node  j  which 
is  directly  connected  to  i  over  link  (i«j).  Consequently,  after 
this  stage,  some  flows  have  been  assigned  to  the  network.  Each 
node  in  group  (b)  is  then  considered.  For  emy  node  j  in  this  group, 
all  feasible  paths  from  i  to  j  are  examined,  and  the  meocimum  flow 
thus  far  assigned  in  any  link  in  each  such  path  is  found.  All 
paths  with  the  smallest  maximum  flow  are  then  considered.  (See 
remarks  in  next  paragraph) .  The  path  whose  total  length  is  mini¬ 
mum  is  then  selected  and  all  traffic  originating  at  i  and  destined 
for  j  is  routed  over  this  path.  All  nodes  in  group  (b)  are  treated 
in  this  manner.  The  same  procedure  is  then  applied  to  all  nodes  in 
group  (c),  (d),  (e)  and  (f)  in  that  order. 
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Modifications  of  Basic  Algorithm 


It  is  also  possible  to  divide  the  traffic  from  i  to  j 
and  send  it  over  more  than  one  feasible  path  but  for  uniform 
traffic  this  is  not  an  important  factor.  Moreover,  we  have 
examined  routing  strategies  for  which  the  selection  of  the 
appropriate  path  from  a  set  of  minimum  node  paths  was  made  by 
examining  a  more  general  function  than  the  minimum  of  the  mzuci- 
mum  link  flows.  The  functions  tested  were  computed  by  examining 
at  every  step  the  already  assigned  traffic  within  each  link  in 
each  path  and  determining  the  least  cost  lixtk  capacity  required 
to  accommodate  this  traffic.  In  one  case«  link  utilization  factors 
were  found  by  computing  the  ratio  of  link  traffic  to  link  capacity. 
The  msocimum  link  utilization  factor  in  each  path  was  used  and  the 
path  selected  for  routing  wm  the  one  whose  maximum  utilization 
factor  was  minimum.  In  another  case,  the  residual  capacity  of 
each  link  was  calculated  as  the  difference  between  the  required 
link  capacity  and  the  traffic  in  that  link.  The  path  whose 
smallest  residual  capacity  was  maximum  was  then  used.  Ties  were 
again  resolved  by  picking  the  shortest  path.  In  each  case,  the 
delays  and  throughput  difference  between  the  basic  routing 
algorithm  and  the  modified  algorithm  were  insignificant. 
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Sensitivity 


Any  network  design  depends  crucially  on  the  forecast  of 
the  traffic  distribution.  If  this  forecast  is  inaccurate,  it 
can  be  expected  that  inefficiencies  in  performance  will  occur. 

In  our  case,  these  inefficiencies  could  be  excessive  time  delay 
at  the  desired  throughput  levels,  or  equivalently,  lower  through¬ 
puts  at  saturation.  In  order  to  determine  the  effect  of  traffic 
variations  on  time  delay  and  throughput,  several  simulation  and 
analysis  experiments  were  conducted. 

Ihe  basic  ARPA  configurations  were  derived  with  essentially 
uniform  (i.e.,  equal)  traffic  between  all  node  pairs.  All  node 
pair  traffic  levels  were  then  increased  at  the  same  rate  until 
time  delay  exceeded  0.2  seconds.  The  average  traffic  per  node 
at  saturation  is  defined  to  be  the  network's  throughput,  ^e 
following  experiment  cem  be  performed  to  examine  the  effect  of 
widely  varying  node  output  rates: 

1.  A  remdom  number  Tr(I)  bounded  by  the  constants  TRL  and 
TRU  (i.e.,  TRLtf  Tr(l);i  TRU)  is  selected  uniformly  at  rzuidom  for 
node  I  for  I  ■  1,  •*•  ,  N.  This  random  number  is  set  equal  to 
the  total  output  of  node  I. 

2.  For  each  node  I,  N-1  non  negative  random  numbers 

X(I,1),  X(I,2),  ,  X(I,N-1)  are  generated  uniformly  at  random, 

^e  traffic  from  node  Z  to  node  J  is  set  equal  to 

TR(I)  X(I,J)/ y  X(I,J) 

j-1 
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3.  The  Minimum  Link  Traffic  Routing  Algorithm  is  applied 
and  the  average  number  of  bits/second  determined. 

4.  Steps  1-3  are  repeated  until  a  statistically  valid 
sample  is  obtained. 

Steps  1-3  were  performed  with  the  twelve  and  eighteen  node 
networks  considered  in  Chapter  1.  Moreover,  in  our  experiments 
TRL  ranged  from  1000  to  2000  bits/sec  and  TRU  ranged  from  19000 
to  38000  bits/sec.  The  steps  were  repeated  200  times  for  the 
twelve  node  network  and  100  times  for  the  eighteen  node  network. 

Tables  2.1  and  2.2  summarize  the  data  collected.  These 
points  are  plotted  in  Figures  2.1  and  2.2  to  show  the  relation¬ 
ship  between  the  sample  probabilities  observed  cmd  the  average 
number  of  bits/second/node  at  saturation.  For  example,  point 
in  Figure  2.1  indicates  that  of  the  200  samples  taken,  24  had 
throughputs  of  18,000  bits/second/node. 

The  effect  of  inaccurate  traffic  forecasts  for  the  two 
networks  can  be  readily  investigated.  In  both  the  twelve  and 
eighteen  node  cases,  throughputs  for  uniform  traffic  distributions 
were  from  10^  to  13?6  higher  than  the  average  throughputs  for  the 
random  samples.  In  addition,  for  both  networks,  more  than  75% 
of  the  random  cases  have  average  throughputs  within  17%  of  the 
uniform  traffic  throughput.  These  numbers  demonstrate  that  the 
degredation  in  performance  caused  by  inaccurate  traffic  forecasts 
is  not  severe.  Moreover,  it  can  be  expected  that  much  of  the 
traffic  will  not  usually  deviate  significantly  from  predicted 
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values.  Therefore,  throughputs  will  generally  be  very  close  to 
their  nominal  values. 

TABLE  2 . 1 
12  Node  Network 


Average  Throughput 
(Bits/Second/Node) 

Number  of 

Traffic  Patterns 

14,000 

i 

1 

15,000 

3 

16,000 

5 

17,000 

16 

18,000 

24 

19,000 

I 

44 

20,000 

1 

39 

21,000 

44 

22,000 

13 

23,000 

8 

24,000 

3 

Sample  Mean  °  20  KBits/Sec/Node 

4 

Seunple  Variance  «>  400  x  10 

Stamdard  Deviation  »  2000  Bits/Sec/Node 
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TABLE  2.2 


18  Node  Network 


Average  Throughput 
(Bits/Second/Node) 

Number  of 
Traffic  Patterns 

13,000 

1 

1 

14,000  1 

5 

15,000 

16 

16,000 

19 

17,000 

1  33 

18, 000 

18 

19,000  . 

5 

1 

20,000 

1 

3 

Saimple  Mean  »  17  KBits/Sec/Node 

Sample  Variance  »  221  x  10^ 

Standard  Deviation  •  1760  Bits/Sec/Node 


Sample  Mean  =  2  OK 


Unif onn  TiafSc  Throughput=23K 

Sample 

Probability 


Empirical  Probability  Distribution  for  12  Node  Network 

Figure  2.1 
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Sample  Mean  =  17K 

Uniform  Traffic  Throughput  =  19K 

Sample 

Probability 


Empirical  Probability  Distribution  for  18  Node  Network 

Figure  2.2 
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COST-THROUGHPUT  CHARACTERISTICS  OF  lARGE  NETWORKS 


The  eubstantlal  cost  advantages  of  computer-communications 
is  of  particular  importance  in  satisfying  the  Defense  Department's 
rapidly  growing  communication  requirements.  Because  this  is  a  new 
field*  much  research  must  be  done  to  uncover  the  tradeoffs  between 
cost*  throughput*  and  time  delay  for  large  networks.  Such  in- 

I 

formation  is  essential  for  long  range  planning.  Our  previous  work 
has  exhibited  these  tradeoffs  for  the  ARPA  Computer  Network.  How¬ 
ever*  these  specific  studies  were  limited  to  networks  with  no  more 
than  twenty-one  nodes  -  those,  proposed  for  inclusion  in  the  net¬ 
work. 


In  this  section*  we  report  the  results  of  our  investigation 
of  the  oost-throughput  characteristics  of  large  networks.  Ihe  goal 
of  the  study  is  to  exhibit  these  characteristics  as  a  function  of 

I 

the  number  of  nodes  in  the  system.  In  order  to  do  this*  a 
systematic  procedure  was  established  to  vary  the  number  of  nodes 
in  the  networks  under  consideration  and  to  then  find  low  cost  con¬ 
figurations  for  given  levels  of  traffic.  Ihe  heart  of  the  pro¬ 
cedure  is  the  network  design  computer  program  described  in 
References  [1]  and  [2].  In  order  to  establish  the  basis  for  our 
results*  we  first  describe  the  assumptions  and  approach. 
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alia  factors  to  be  discussed  Include  t 

(1)  Selection  of  Mode  Locations 

(2)  cost  Factors 

(3)  Netvrork  Model 

(4)  Network  Optimization  Program 

(5)  Selection  of  Node-to-MOde  Traffic 

Selection  of  Node  Locations 

Our  previous  studies  indicated  that  node  locations  strongly 
influence  network  efficiency.  For  example,  at  one  traffic  level  a 
sixteen  node  network  may  be  more  efficient  than  the  same  network 
with  two  additional  nodes  while  it  may  be  less  efficient  at  other 
traffic  levels.  Consequently,  a  rigorous  basis  is  required  to 
generate  realistic  systems  with  differing  nundaers  of  nodes. 

Many  location  algorithms  are  possible.  For  example,  nodes 
could  be  located  on  the  basis  of 

(1)  industrial  concentration 

(2)  distribution  of  military  bases 

(3)  distribution  of  universities 

(4)  population 

Since  both  industry  and  universities  tend  to  be  located  at  population 
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centers,  distributions  produced  by  these  factors  are  positively 
correlated.  On  the  other  hand,  military  bases  are  often  located 
at  a  distance  from  population  centers,  and  hence  such  nodal 
distributions  would  have  a  negative  correlation  with  the  others. 

ihe  nodal  distribution  selected  was  based  purely  on 
population.  A  list  of  the  fifty  most  populated  (1960  census) 
metropolitan  areas  was  used.  These  cities,  with  their*  latitudes, 
longitudes  and  populations  are  shown  in  Table  3.1.  A  required 
ratio  R  of  population  to  nuxnber  of  ZMP's  was  assigned  to  each  node, 
so  that  if  there  were  P  people  in  a  given  metropolitan  area  [P/R] 
nodes  would  be  assigned  to  that  area,  where  [x]  represents  the 
largest  integer  no  greater  than  x.  Therefore,  varying  R  would 
vary  both  the  number  of  nodes  in  the  system,  and  the  location  of 
these  nodes. 

As  an  example,  if  R  ■  2,000,000,  only  areas  with  at  least 
2,000,000  people  would  be  assigned  an  Interface  Message  Processor. 
Since  the  New  York  area  has  a  population  of  10,602,382  it  would 
have  five  IMP'S.  The  Los  Angeles  area  would  have  three  IMP'S,  the 
Chicago  area  three  IMP'S,  and  so  on.  (As  a  conservative  figure, 
distances  between  IMP'S  in  the  same  metropolitan  area  were  taken 
to  be  twenty  miles) .  ^e  overall  system  would  then  contain  nine 
distinct  metropolitan  areas  with  a  total  of  eighteen  IMP '  s . 

Table  '3.2  indicates  these  relationships  as  a  function  of  R.  * 
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All  liBBB  folly  duplox 


690.00 

1 

0.40 

890.00 

1 

2.90 

890.00 

$ 

9.00 

1300.00 

1 

30.00 

3.9 


I  as«700 


•tAiidteffd  Sl«  XNf 
with  up  to  i  03e- 
turnul  fully 
duplox  Ums* 


leonoiV  3ia  W  I  ia«iOO 

with  up  to  3  o»* 
turaul  fully 
duplex  lines. 

Psoeessiag  cute 
is  3/4  that  of 
S16  DIP. 


Hf3gf9th  M9<lf  1 


1ti«  iNMie  Mtwork  nod*!  is  dsseribsd  in  dstsil  in 
Rsfsrsnest  (1)  and  (3)«  TO  cooplsosnt  this  dsteriptien*  ifs 
point  out  ssvorsl  ioportsnt  ohsrsotoriotios  in  ths  aodsl. 

(1)  Tlio  oqiistion  for  nodoling  tioo  dolny  is  givon 
in  toetion  1  on  Optiaml  Pouting* 

(2)  Ninimn  LiOk  Ttoffie  Pouting#  ss  dsseribsd  in 
foetion  2  •  is  used* 

(2)  Aoeoptoblo  tisM  dolny  is  0*S  ssecnds  for  Short 


(4)  tSK  of  nil  ■sssngos  nro  Short* 

(5)  Ixospt  in  the  initinl  oxpsrisMnts  on  trsffio 
pnttoms#  nil  noesptnblo  notuork  oenfigumtions  nust  bo  *tMO 
oonnootod**  Thnt  is#  nt  lonst  two  nodes  nn^or  links  nust  foil 
before  nil  pntbs  between  nay  pnir  of  nodes  ere  broken* 
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Notwork  Optimization  Program 


iMtwork  optimisAtion  peoqrm  Lb  a  mof  AOi^iAtiettAd 
VArsion  of  tho  on#  dosoribod  in  RAftronoos  [1]  And  [2].  ihA 
progrAA  Ia  givon  a  "AtArting**  notMork*  Zt  thon  AAArdhAA  for 
nodifioAtioriA  of  thlA  notwork  «diidh  roduoo  tho  eoAt  por  bit  of 
trAnABdttod  infocMtion  Whilo  eontinuing  to  oAtiofy  All  eon- 
AtrAintA*  MAtwork  nodifioAtiono  oeoAiAt  of  Addition!  or  do* 
lotionA  of  linkA  oithor  one  or  aero  At  a  tiM.  lAdh  tiao  a 
•odifioAtien  iA  AKAainod  tho  routing  Algoritfea  io  rooppliod  to 
dotoraino  tho  Avorogo  dolAy  of  tho  now  notwerk* 

BooAUAo  of  tho  high  froqooney  of  uao  of  tho  routing  a1* 
goritha«  opooiol  oubroutinoA  oro  dooignod  to  ainiaimo  tho 
eonputotion  tint  At  oAoh  atop*  Iho  booie  olgwitha  eporotoo  by 
AAAigning  nuaboro#  eollod  "lAbolo**  to  oAch  node*  Proa  thooo 
lAbolo#  tho  optiaua  potho  oro  oAloulotod  for  tho  ovoroll  not- 
uerk.  fho  opooiol  oubroutinoo  oporoto  by  oraaining  thooo  lobolo 
boCoro  A  ehoago  ia  tho  notaerk  atruoturo  ia  aado  and  oAleulAtiag 
tho  offoetA  of  tho  dhoago  without  roooanuting  oil  of  tho  lobolo. 
IhoAo  oubroutinoo  uauAlly  roduoo  eeaputotioa  tiao  by  a  footer  of 
ton  «dtoa  coaporod  to  a  otroightioruArd  oppliootion  of  tho  boaie 
routing  olgeritha. 
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Hi*  aetual  Mtidork  optimisation  is  bssod  on  s  "rogionsl 
dsoomposition"  prinoipls.  systom  is  dividod  into  rogions. 
Nodos  sro  thon  uniquoly  sssignod  to  osoh  rogion.  itioso  nodos 
sro  olsssifiod  ss  oithor  oontrsl  nodos  or  IfiSil  nodos.  fhoro 
■sy  bo  sny  nuabor  of  rogions«  sad  tho  dhoioo  of  loosl  and  eontral 
nodos  is  Mdo  by  tho  dosignor.  Iho  distinotion  bitwoon  nodos 
•tmm  txom  rootrietions  on  allowoblo  oonaootions. 

(1)  Within  a  givon  rogion  any  oonnootion  is  poosiblo. 

(2)  oonnoetions  botwoon  rogions  aro  oniy  allowod  botwoon 
ooatral  nodos. 

(3)  Any  oonnootion  botwoon  ooatral  nodos  is  poosiblo. 

fhoroftro*  a  flow  from  a  looal  nods  in  iogiea  X  to  a  looal  nods 
in  Mgion  J  nust  bo  routod  first  to  a  ooatral  nods  in  bsgioo  X« 
than  through  a  "global*  aotwork  oonpoood  of  oontral  nodos  to  a 
eontral  nods  in  mgion  J  and  finally  to  tho  looal  dostination 
nods  in  hogien  J.  thus*  in  goaoral  a  *hoirarchal*  aotwork  is 
ttood.  xf  dosirod  struetural  eonotraiats  oaa  bo  olisdaatod  by 
doclaring  story  aedo  to  bo  a  ooatral  nods,  xa  this  eaoo*  thoro 
aro  H(V-l)/3  poosiblo  links  %dioro  V  is  tho  auobor  of  nodos  in 
tho  aotwork.  Xf  ■  is  largo«  tho  oesviitatieoal  tins  roquirod 
for  eptisdsation  nay  bo  prebibitiwo*  and  thoroforo  doeonpooition 
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is  ossoncial.  For  tha  oisos  of  tho  notworks  boiag  eonoidorod#  tho 
docoaposition  spprosoh  producos  eoaputotioo  tiM  Mviags  rouging 
frocn  o  factor  of  un  to  foetors  of  noro  than  400.  A  typieol  ox- 
aaplo  of  a  regional  doeonpooitioo  is  dhoim  in  riguro  3.1* 

Seloction  of  Mods* 

s 

A  fundaoMatol  problon  in  oil  aotMork  dooiga  is  tho  osti- 
motion  of  tho  traffic  tho  aatwork  must  ooooHMdota*  Por  seas 
problams  occurota  astimatas  of  usar  rsgoirunts  may  ha  knoim* 
unfortunataly«  tha  field  of  ocaputar  on— Mntoations  is  so  aao  that 
cooplata  studios  aso  not  yst  availabls  to  pcodiot  the  flow  rsguirs* 
mants  in  ganaral  nstworka  of  the  typo  hoing  oonsidsrsd  hors*  in 
fact*  a  nushsr  of  basio  quootions  about  tho  natuco  of  thsso  flows 
era  yat  to  ha  sasolvad.  por  axanvlo#  it  is  raasonabls  to  assuma 
that  tha  flow  out  of  a  node  will  ha  preportipoal  to  tha  population 
assignad  to  that  node.  Bowsvar#  will  tha  flow  hotwasn  two  nodas  ha 
affactad  by  tha  distanea  hatwaan  thasa  nodas?  If  so*  how  will  tha 
cost-throughput  charaetaristios  of  tha  natwesk  ha  affsetad? 

zn  ordar  to  invastigata  tha  affaet  of  diffarant  traffic 
distributions  on  aatwork  aoonosqr#  a  saquanea  of  axparimants  wara 
conductad  in  %fhicih  traffic  pattams  wars  variad  and  low  eoat  aat- 
works  for  thasa  pattams  gaaaratad.  lhasa  axparimants  ara  dasoribad 
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Bxanpl*  of  Roglonal  Doconqposltlon 
PIOURB  3.1 
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Houston 


AS  follows.  Tho  traffic  out  of  sach  nods  in  city  with  popu¬ 
lation  is  equal  to  KP^/[P^/R]  where  R  is  the  required  popu¬ 
lation  per  IMP/  and  K  is  a  constant  which  determines  the  "traffic 
level."  The  traffic  from  ea^  node  in  this  city  to  any  node  in 


city  is  equal  to 


K(P^/[P^/Rl) 


(PyiP/RDd 
j  j  i/R 


1 


Where  d  is  the  distance  between  C  and  C  for  d  >20 
i,j  i  j  i/i 

miles /  and  «  is  a  non-negative  constant.  If  e(  ■  0/  traffic 
between ’Cities  is  independent  of  distance  while  if  o(  ■  1/ 
traffic  follows  the  well  known  "gravity  law." 

For  a  fixed  number  N  of  nodes  and  fixed  ec  /  K  is  varied. 
Each  value  of  K  gives  a  specified  distribution  of  traffic  for  which 
a  low  cost  network  can  be  found.  For  each  K  a  point  on  curves  of 
cost  versus  bits/sec/node  and  cost  versus  cost  per  megabit  of 
transmitted  information  is  thus  determined.  By  varying  K,  a  num¬ 
ber  of  values  of  these  parameters  are  found. 


The  above  experiment  was  applied  for  N  >  40  and  d  >  0.0/ 

0.5  and  1.0.  Typical  traffic  matrices  for  cv  >  0  emd  1  are 
shown  in  Tables  2.5(a)  and  (b)  below.  In  these  tables/  the  traffic 
from  one  IMP  in  each  city  to  one  IMP  in  each  other  c  ity  is  shown.  For  the 
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forty  node  network,  the  dlctrlbutlon  of  cities  and  IMF's  is  as 
follows t 


Metropolitan  Area 

Number  of  IMF's 

(1) 

New  York 

8 

(2) 

Los  Angeles 

5 

(3) 

Chicago 

5 

• 

(4) 

Philadelphia 

3 

(5) 

Detroit 

3 

(6) 

San  Francisco 

2 

(7) 

Boston 

2 

(8) 

Pittsburgh 

2 

(9) 

St.  Louis 

1 

(10) 

Washington,  D.  C. 

1 

(11) 

Cleveland 

1 

(12) 

Baltimore 

1 

(13) 

Newark 

1 

(14) 

Mituieapolis 

1 

(15) 

Buffalo 

1 

(16) 

Houston 

1 

(17) 

Milwaukee 

1 

(18) 

Paterson 

1 
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The  above  IMP  distribution  list  can  be  used  as  a  guide  to  inter¬ 
pret  the  entries  in  Tables  3  .5  (a)  and  (b) .  For  example,  each  of 
the  eight  IMP' s  in  New  York  generate  the  traffic  listed  under  the 
New  York  entry.  From  each  such  IMP,  the  traffic  to  each  IMP  in 
the  metropolitan  area  numbered  i  is  equal  to  the  i^^  entry  listed 
under  New  York.  Thus,  the  traffic  from  each  of  the  eight  IMP'S 
in  New  York  to  each  of  the  3  IMP'S  in  Detroit  is  equal  to  1238 
bits/sec  when  o<  «  0. 

The  experiments  were  run  before  exact  costs  for  hardware 
were  available  and  hence  preliminary  estimates  of  the  costs  and 
constraints  on  the  IMP'S  were  used.  Each  "global"  network  (i.e., 
the  network  connecting  the  central  nodes)  was  required  to  be  two 
connected,  but  the  regional  networks  were  only  required  to  be  one 
connected.  That  is,  in  these  networks,  the  failure  of  a  single 
node  or  line  could  disconnect  a  local  node  from  the  remainder  of 
the  system.  In  later  studies,  this  requirement  was  chemged  to 
two  connectivity  because  of  prelimin^u:y  statistics  that  showed 
that  single  line  failures  occur  relatively  frequently.  Finally, 
the  data  set  for  the  10.4  KB  line  was  priced  somewhat  lower  in  the 
traffic  studies  than  in  later  designs.  Hence,  the  costs  in  the 
traffic  studies  for  the  forty  node  networks  that  are  given  in  Table 
3.6  and  displayed  in  Figures  3.2  and  3.3  are  not  directly  compatable 
with  the  costs  given  later  in  the  report. 
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TABLE  3.5(a) 


TRAFFIC  DISTRIBUTION.  =  0 


New 

York 

(each  IMP) 

(1) 

131 

(2) 

132 

(3) 

122 

(4) 

142 

(5) 

123 

(6) 

135 

(7) 

127 

(8) 

118 

(9) 

203 

(10) 

195 

(11) 

177 

(12) 

169 

(13) 

167 

(14) 

146 

(15) 

129 

(16) 

122 

(17) 

175 

(18) 

117 

Los 

Anaeles 

(each  IMP)  . 

(1) 

132 

(2) 

133 

(3) 

123 

(4) 

143 

(5) 

124 

(6) 

136 

(7) 

128 

(8) 

119 

(9) 

204 

(10) 

196 

(11) 

178 

(12) 

170 

(13) 

168 

(14) 

147 

(15) 

130 

(16) 

123 

(17) 

118 

(18) 

118 

Chicaoo 

(each  IMP) 

(1) 

122 

(2) 

123 

(3) 

113 

(4) 

132 

(5) 

115 

(6) 

125 

(7) 

118 

(8) 

103 

(9) 

188 

(10) 

164 

(11) 

164 

(12) 

157 

(13) 

115 

(14) 

136 

(15) 

120 

(16) 

114 

(17) 

109 

(18) 

109 

Philadelphia 

(each 

IMP) 

• 

(1) 

123 

(2) 

124 

(3) 

115 

(4) 

151 

(5) 

133 

(6) 

127 

(7) 

119 

(8) 

111 

(9) 

190 

(10) 

183 

(11) 

166 

(12) 

159 

(13) 

157 

(14) 

137 

(15) 

121 

(16) 

115 

(17) 

110 

(18) 

110 
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TABLE  3.5(a)  (Conf  d) 


5.  Detroit  (each  IMP) 


(1) 

123 

(2) 

124 

(3) 

151 

(4) 

133 

(5) 

116 

(6) 

127 

(7) 

119 

(8) 

111 

(9) 

190 

(10) 

183 

(11) 

166 

(12) 

159 

(13) 

157 

(14) 

137 

(15) 

121 

(16) 

115 

(17) 

110 

(18) 

110 

6. 

San 

Francisco 

(each  IMP) 

(1) 

135 

(2) 

136 

(3) 

126 

(4) 

146 

(5i 

127 

(6) 

139 

(7) 

131 

(8) 

122 

(9) 

209 

(10) 

201 

(11) 

182 

(12) 

174 

(13) 

171 

(14) 

150 

(15) 

132 

(16) 

126 

(17) 

121 

(18) 

120 

7. 

Boston  (each  IMP) 

(1) 

127 

(2) 

128 

(3) 

118 

(4) 

137 

(5) 

119 

(6) 

130 

(7) 

123 

(8) 

114 

(9) 

196 

(10) 

188 

(11) 

171 

(12) 

164 

(13) 

161 

(14) 

141 

(15) 

125 

(16) 

118 

(17) 

137 

•  (18) 

113 

8. 

Pittsburah 

(each  IMP) 

(1) 

118 

(2) 

119 

(3) 

110 

(4) 

128 

(5) 

111 

(6) 

128 

(7) 

114 

(8) 

106 

(9) 

182 

(10) 

175 

(11) 

159 

(12) 

152 

(13) 

150 

(14) 

131 

(15) 

116 

(16) 

110 

(17) 

105 

(18) 

105 

9. 

St. 

Louis 

(1) 

205 

(2) 

207 

(3) 

191 

(4) 

222 

(5) 

193 

(6) 

211 

(7) 

199 

(8) 

185 

(9) 

0 

(10) 

305 

(11) 

277 

(12) 

265 

(13) 

261 

(14) 

229 

(15) 

202 

(16) 

192 

(17) 

184 

(18) 

183 
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TABLE  3.5(a)  (Cont'd) 


10.  Washington ,  D.  C. 


(1) 

197 

(2) 

198 

(3) 

184 

(7) 

191 

(8) 

178 

(9) 

305 

(13) 

251 

(14) 

219 

(15) 

194 

11.  Cleveland 

(1) 

178 

(2) 

180 

(3) 

166 

(7) 

173 

(8) 

161 

(9) 

276 

(13) 

227 

(14) 

198 

(15) 

175 

12 .  Baltimore 

(1) 

170 

(2) 

171 

(3) 

158 

(7) 

165 

(8) 

154 

(9) 

263 

(13) 

216 

(14) 

189 

(15) 

167 

13 .  Newark 

(1) 

168 

(2) 

169 

(3) 

156 

(7) 

162 

(8) 

151 

(9) 

259 

(13) 

0 

(14) 

187 

(15) 

165 

14.  Minneapolis 

(1) 

146 

(2) 

147 

(3) 

136 

(7) 

142 

(8) 

132 

(9) 

226 

(13) 

186 

(14) 

0 

(15) 

144 

(4) 

213 

(5) 

186 

(6) 

203 

(10) 

0 

(11) 

266 

(12) 

254 

(16) 

184 

(17) 

176 

(18) 

176 

(4) 

193 

(5) 

168 

(6) 

183 

(10) 

265 

(11) 

0 

(12) 

230 

(16) 

166 

(17) 

159 

(18' 

159 

(4) 

184 

(5) 

160 

(6) 

175 

(10) 

253 

(11) 

230 

(12) 

0 

(16) 

159 

(17) 

152 

(18) 

1.52 

(4) 

181 

(5) 

158 

(6) 

172 

(10) 

249 

(11) 

226 

(12) 

216 

(16) 

156 

(17) 

150 

(18) 

150 

(4) 

158 

(5) 

138 

(6) 

150 

(10) 

217 

(11) 

197 

(12) 

189 

(16) 

136 

(17) 

131 

(18) 

131 
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TABLE  -^.5(3)  (Cont'd) 


15 .  Buffalo 


(1) 

129 

(2) 

129 

(3) 

120 

(4) 

139 

(5) 

121 

(6) 

132 

(7) 

125 

(8) 

116 

(9) 

199 

(10) 

191 

(11) 

174 

(12) 

166 

(13) 

163 

(14) 

143 

(15) 

0 

(16) 

120 

(17) 

115 

(18) 

115 

16.  Houston 

(1) 

122 

(2) 

123 

(3) 

114 

(4) 

132 

(?) 

115 

(6) 

126 

(7) 

118 

(8) 

110 

(9) 

189 

(10) 

181 

(11) 

165 

(12, 

157 

(13) 

155 

(14) 

136 

(15) 

120 

(16) 

0 

(17) 

109 

(18) 

109 

17.  Milwaukee 

(1) 

117 

.  (2) 

118 

(3) 

109 

(4) 

126 

(5) 

110 

(6) 

120 

(7) 

113 

(8) 

105 

(9) 

181 

(10) 

174 

(11) 

158 

(12) 

151 

(13) 

148 

(14) 

130 

(15) 

115 

(16) 

109 

(17) 

0 

(18) 

104 

18.  Paterson 

(1) 

117 

(2) 

117 

(3) 

109 

(4) 

126 

(5) 

110 

(6) 

120 

(7) 

113 

(8) 

105 

(9) 

180 

(10) 

173 

(11) 

157 

(12) 

150 

(13) 

148 

(14) 

130 

(15) 

115 

(16) 

109 

(17) 

104 

(18) 

0 
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TABLE  3.5 fb) 


TRAFFIC  DISTRIBUTION.  Ot  °  1 


1.  New  York  (each  IMP) 


(1) 

220 

(2) 

1 

(3) 

6 

(4) 

18 

(5) 

13 

(6) 

1 

(7) 

7 

(8) 

49 

(9) 

8 

(10) 

40 

(11) 

29 

(12) 

33 

(13) 

16 

(14) 

4 

(15) 

38 

(16) 

3 

(17) 

f 

6 

(18) 

11 

2.  Los 

Ancreles  (each  IMP) 

(1) 

3 

(2) 

456 

(3) 

3 

(4) 

3 

(5) 

3 

(6) 

26 

(7) 

2 

(8) 

3 

(9) 

7 

(10) 

4 

(11) 

4 

(12) 

4 

(13) 

3 

(14) 

5 

(15) 

3 

(16) 

5 

(17) 

3 

(18) 

2 

3 .  Chicacro 

(each 

IMP) 

(1) 

11 

(2) 

3 

(3) 

339 

(4) 

9 

(5) 

22 

(6) 

3 

(7) 

6 

(8) 

12 

(9) 

46 

(10) 

14 

(11) 

23 

(12) 

12 

(13) 

9 

(14) 

19 

(15) 

11 

(16) 

8 

(17) 

91 

(18) 

6 

4.  Philadelphia  (each  IMP) 

(1) 

37 

(2) 

3 

(3) 

10 

(4) 

523 

(5) 

16 

(6) 

3 

(7) 

30 

(8) 

25 

(9) 

14 

(10) 

104 

(11) 

28 

(12) 

119 

(13) 

149 

(14) 

8 

(15) 

32 

(16) 

6 

(17) 

9 

(18) 

99 
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T/\DLE  3.5(b)  (Cont'd) 


5.  Detroit  (each  IMP) 


(1) 

32 

(2) 

4 

(3) 

30 

(4) 

19 

(5) 

474 

(6) 

3 

(7) 

11 

(8) 

37 

(9) 

29 

(10) 

32 

(11) 

122 

(12) 

27 

(13) 

20 

(14) 

15 

(15) 

32 

(16) 

8 

(17) 

26 

(18) 

14 

6. 

San 

Francisco  (each  IMP) 

(1) 

8 

(2) 

75 

(3) 

10 

(4) 

8 

(5) 

.8 

(6) 

1348 

(7) 

7 

(8) 

8 

(9) 

18 

(10) 

12 

(11) 

12 

(12) 

10 

(13) 

9 

(14) 

14 

(15) 

8 

(16) 

12 

(17) 

9 

(18) 

6 

7. 

Boston  (sach  IMP) 

(1) 

32 

(2) 

5 

(3) 

14 

(4) 

62 

(5) 

19 

(6) 

5 

(7) 

857 

(8) 

25 

(9) 

20 

(10) 

59 

(11) 

32 

(12) 

55 

(13) 

99 

(14) 

12 

(15) 

32 

(16) 

9 

(17) 

13 

(18) 

70 

8. 

Pittsburah 

(each  IMP) 

(1) 

101 

(2) 

3 

(3) 

14 

(4) 

26 

(5) 

31 

(6) 

2 

(7) 

12 

(8) 

366 

(9) 

17 

(10) 

53 

(11) 

84 

(12) 

43 

(13) 

25 

(14) 

9 

(15) 

54 

(16) 

6 

(17) 

12 

(18) 

17 

9. 

St, 

Louis 

(1) 

62 

(2) 

25 

(3) 

192 

'4) 

51 

(5) 

89 

(6) 

22 

(7) 

36 

(8) 

62 

(9) 

0 

(10) 

80 

(11) 

110 

(12) 

67 

(13) 

56 

(14) 

147 

(15) 

59 

(16) 

82 

(17) 

161 

(18) 

39 
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TABLE  3.5 fb)  (Cont ' d) 


10.  Waghinq&on.  D.  c. 


(1) 

116 

(2) 

6 

(3) 

22 

(4) 

146 

(5) 

37 

(6) 

6 

(7) 

40 

(8) 

74 

(9) 

31 

(10) 

0 

(11) 

70 

(12) 

670 

(13) 

107 

(14) 

17 

(15) 

75 

(16) 

12 

(17) 

20 

(18) 

74 

11. 

Clavol&nd 

(1) 

105 

(2) 

8 

(3) 

47 

(4) 

50 

(5) 

180 

(6) 

7 

(7) 

27 

(8) 

148 

(9) 

53 

(10) 

89 

(11)’ 

0 

(12) 

74 

(13) 

51 

(14) 

28 

(15) 

99 

(16) 

17 

(17) 

42 

(18) 

36 

12. 

Bmltlmor# 

(1) 

88 

(2) 

5 

(3) 

18 

(4) 

156 

(5) 

29 

(6) 

4 

(7) 

35 

.(8) 

56 

(9) 

24 

(10) 

627 

(11) 

55 

(12) 

0 

(13) 

103 

(14) 

U 

(15) 

62 

(16) 

10 

(17) 

16 

(18) 

71 

13. 

Kgwarlc 

(1) 

49 

(2) 

5 

(3) 

16 

(4) 

213 

(5) 

24 

(6) 

49 

(7) 

69 

(8) 

35 

(9) 

22 

(10) 

109 

(11) 

41 

(12) 

112 

(13) 

0 

(14) 

13 

(15) 

46 

(16) 

9 

(17) 

14 

(18) 

723 

14. 

Minna&DOlia 

(1) 

46 

(2) 

26 

(3) 

104 

(4) 

40 

(5) 

62 

(6) 

23 

(7) 

29 

(8) 

45 

(9) 

194 

(10) 

60 

(11) 

77 

(12) 

51 

(13) 

44 

(14) 

0 

(15) 

46 

(16) 

57 

(17) 

111 

(18) 

31 
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TABLE  3.5(b)  (Cont'd) 


15.  Buffalo 


(1)  118 

(2) 

4 

(3) 

20 

(4) 

49 

(5) 

41 

(6) 

4 

(7)  23 

(8) 

81 

(9) 

24 

(10) 

81 

(11) 

84 

(12) 

72 

(13)  48 

(14) 

14 

(15) 

0 

(16) 

9 

(17) 

18 

(18) 

34 

16.  Houston 

(1)  42 

(2) 

33 

(3) 

62 

(4) 

39 

(5) 

48 

(6) 

28 

(7)  29 

(8) 

40 

(9) 

147 

(10) 

59 

(11) 

65 

(12) 

50 

(13)  43 

(14) 

7 

(15) 

40 

(16) 

0 

(17) 

57 

(18) 

30 

17.  Milwaukee 

(1)  23 

(2) 

7 

(3) 

197 

(4) 

18 

(5) 

42 

(6) 

6 

(7)  12 

.  (8) 

23 

(9) 

83 

(10) 

28 

(11) 

45 

(12) 

23 

(13)  19 

(14) 

43 

(15) 

23 

(16) 

16 

(17) 

0 

(18) 

13 

18.  Paterson 

(1)  31 

(2) 

3 

(3) 

10 

(4) 

128 

(5) 

15 

(6) 

3 

(7)  44 

(8) 

22 

(9) 

14 

(10) 

68 

(11) 

26 

(12) 

69 

(13)  65 

(14) 

8 

(15) 

29 

(16) 

6 

(17) 

9 

(18) 

0 

3.26 


However,  to  avoid  the  extra  manpower  and  computer  time  needed  to 
repeat  the  atudies  with  the  higher  costs,  the  traffic  experiments 
were  not  rerun  since  it  is  felt  that  the  results  are  representative 


Table  3.6  indicates  the  costs  and  throughputs  generated  by 
the  procedure  indicated  above.  The  results  tend  to  indicate  that 
for  given  throughputs,  slightly  lower  cost  designs  can  be  obtained 
for  greater  values  of  ck  (i.e.,  for  traffic  patterns’ with  which 
favor  flows  between  nodes  close  together) .  ohese  costs  and  through¬ 
puts  are  graphed  in  Figures  3.2  and  3  .3.  However,  the  cost 
differentials  between  traffic  patterns  with  o(  ■>  1  (the  gravity 
law)  and  oi  ■  0  (no  distance  bias)  do  not  appear  to  be  significant. 
Therefore,  for  latter  studies  traffic  patterns  without  distance 
bias  were  used  exclusively.  Thus,  the  flow  from  a  node  in  city 
with  population  to  a  node  in  city  with  population  was 
assumed  to  be 


K(P^/[Pi/R] 


{P^/[P^/R]) 

Ev'V" 


for  if^j.  The  flow  from  a  node  in  city  to  another  node  in  the 

same  city  is  2  2 

KPi  /[P^/R] 

Ev'v*’ 

Naturally,  there  is  aero  flow  from  any  node  to  itself. 
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TABLE  3.6 


oc 

Yearly 

Cost 

(M$) 

Yearly 
Cost/Node 
(K$)  _ 

Total 

K  Bits/Sec 
of  Data 

K  Bits/Sec/NOde 

Cost/Megabit  of  Data 
(24  hours/day 
operation) 

0.0 

$1.64  M 

$41  K 

172 

4 

30 

0.0 

$1.68 

$42 

219 

5 

25 

0.0 

$1.80 

$45 

290 

7 

20 

0.0 

$1.84 

$46 

323 

8 

18 

0.0 

$1.96 

$49 

538 

13 

12 

0.0 

$2.00 

$50 

944 

24 

7  ^ 

0.0 

$2.16 

$54 

924 

23 

8 

0.0 

$2.16 

$54 

1010 

25 

6 

o:o 

$2.20 

$55 

1028 

26 

7 

0.5 

$1.70 

$45 

301 

8 

19 

0.5 

$1.88 

$47 

379 

9 

16 

0.5 

$2.08 

$52 

877 

22 

8 

0.5 

$2.24 

$56 

1062 

27 

7 

1.0 

$1.68 

$42 

282 

7 

19 

1.0 

$1.72 

$43 

255 

6 

21 

1.0 

$1.80 

$45 

331 

8 

18  ‘ 

1.0 

$2.00 

$50 

495 

12 

14 

1.0 

$2.08 

$52 

763 

19 

9 

1.0 

$2.20 

$55 

1146 

29 

5 
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X  $/Nod«/Year 


cents 

per 

megabit 

25 


20 


IS 


10 
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Large  N«twork  Charaeteriatics 


in  this  section  we  Indicate  the  results  of  our  study  to 
uncover  cost- throughput  tradeoffs  as  a  function  of  the  nuniber 
of  nodes  in  the  network.  First*  i^e  sunmarlse  the  factors  al¬ 
ready  discussed  which  Influence  the  network  designs. 

1.  Systems  considered  contain  20*  40*  60*  80*  and  100 
IMP'S  and  cover  respectively  the  10*  16*  26*  32*  and  40  largest 
metropolitan  areas  In  the  Continental  united  States  I 

2.  Rsqpilred  traffic  between  any  two  IMP'S  Is  Independent 
of  distance.  From  an  IMP  In  city  with  population  P^  to  an 
IMP  In  city  Cj  with  population  Pj*  the  traffic  flow  reqpilre- 
ment  la 

K  (Pi/  (Pi  /P3)  (Pj/  I  Pj/Rl  ) 

^  (Pk/  tPk/  »1  ) 

where  K  Is  a  positive  constant  and  R  is  the  required  population 
per  IMP. 

3.  Messages  are  asstaned  to  have  the  same  packet  structure 
and  formats  as  in  the  ARPA  Mtwo^k  as  described  In  [1]  and  [2]. 
65%  of  all  messages  are  assumed  to  be  single  packets. 

4.  In  any  acceptable  network  design*  a  minimum  of  two 
nodes  an4/or  links  must  fail  before  all  paths  are  broken  between 
any  pair  of  nodes. 

5.  Throughput  Is  equal  to  the  average  nuniber  of  bits/ 
secon4/node  which  causes  an  average  short  message  delay  of  0.5 
seconds. 
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6.  Only  hardware  presently  being  used  in  the  ARPA  Network 
is  used  in  any  design.  Only  coimunication  link  options  present^ 
available  to  ARPA  are  used  in  the  design. 

An  important  point  which  must  be  emphasized  is  that  the 
results  to  follow  present  a  conservative  picture  of  the  rela¬ 
tionship  between  cost  and  throughput.  There  are  two  major 
reasons  for  this: 

1)  Each  point  on  each  curve  represents  a  feasible  netvork 
obtained  by  the  computer  network  design  program.  Thus,  to 
generate  the  specified  throughput,  no  greater  cost  would  be 
Involved.  However,  because  of  the  number  of  points  needed  to 
generate  adequate  curves,  it  is  prohibitively  costly  to  devote 
a  large  amount  of  computer  time  to  completely  optimize  each 
design  point.  Therefore,  if  a  specific  throughput  were  to  be 
required,  a  more  thorough  optimization  would  be  warranted  and 

a  lower  cost  design  iirould  be  probable. 

2)  in  each  design,  only  the  presently  available  hardware 
and  line  options  have  been  allowed.  Other  equipment  is 
presently  being  developed  and  other  communication  options 
will  be  available  in  the  near  future.  For  example,  in  [1]  and 
[  2  ]  we  discussed  the  economics  created  by  using  a  108  Kilobit/ 
Second  data  set.  Although  this  data  set  has  been  developed  by 
AT&T,  it  is  not  yet  a  coonerolal  offering.  However,  the  costs 
involved  in  building  a  large  computer  network  would  justify  the 
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Independent  development  of  such  a  data  set.  Moreover#  more 
powerful  Interface  Message  Processors  could  be  developed  with 
existing  hardware.  Such  IMP'S  might  considerably  enhance 
network  performance  at  high  data  rates. 

Because  of  the  above  factors#  the  numerical  relationships 
that  follow  can  be  considered  to  be  the  result  of  a  worst  case 
analysis.  However#  we  feel  that  they  realistically  represent 
the  behavior  of  large  computer  networks  and  that  while  some 
reductions  in  cost  or  increases  in  throughput  are  possible# 
the  fundamental  relationship  between  these  quantities  is 
accurately  depicted. 

Table  3.7  shows  cost#  throughputs#  and  other  relevant  data 
for  a  nianber  of  20#  40#  60#  80#  and  100  node  networks  designed 
by  the  network  optimisation  program.  This  data  is  displayed 
in  Figures  3  .4#  3.5#  and  3.6.  Figure  3.4  indicates  the  relation¬ 
ship  between  cost  per  node  and  the  average  number  of  bits  out 
of  each  node.  In  the  figure#  the  location  of  a  point  corres¬ 
ponding  to  an  i  'x  10  node  net%irork  is  indicated  by  the  numeral 
i.  In  a  similar  manner#  Figure  3.5  shows  the  tradeoffs  between 
cost  per  node  and  cost  per  megabit  of  transmitted  data. 

in  Figure  3.6#  the  average  number  of  bits  out  of  each  node 
is  taken  as  a  parameter.  In  this  figure#  the  abscissa  corres¬ 
ponds  to  the  number  of  nodes  in  the  network  while  the  ordinate 
represents  the  cost  per  node.  The  number  attached  to  each  point 
is  the  average  output  per  node  for  that  network. 
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TABLE  3.7 


Number 
of  Nodes 

YSar3y  Cost 
(M$) 

Ybarly  Cost 
per  Node 
(K$) 

1 

Total  KBits 
Per  Second 

KBits  per 
Second  per 
Node 

Cost  per  Megabit 
of  Data  at24hr^dey 
(cents) 

0.66 

33.0 

62 

3.1 

33.7 

0.79 

39.5 

157 

7.8 

16.0 

0.96 

48.2 

195 

9.7 

15.7 

1.01 

50.7 

208 

10.4 

15.5 

20 

1.08 

54.2 

278 

13.9 

12.4 

1.33 

66.7 

452 

22.6 

9.4 

1.36 

68.0 

505 

25.2 

8.6 

1.29 

32.2 

104 

2.6 

39.3 

1.70 

42.7 

304 

7.6 

17.8 

40 

2.05 

51.4 

492 

12.^ 

13.2 

2.53 

63.3 

750 

18.7 

10.7 

2.95 

73.7 

903 

22.6 

10.4 

2.25 

37.5 

167 

2.8 

42.7 

2.89 

48.1 

405 

6.8 

22.6 

60 

3.23 

53.8 

843 

14.0 

12.2 

4.42 

73.7 

1035 

17.2 

13.6 

5.15 

85.9 

1378 

23.0 

11.9 

32.5 

133 

1.7 

61.9 

36.4 

244 

3.0 

38.0 

38.9 

326 

4.1 

30.2 

80 

4.49 

56.2 

865 

10.8 

16.5 

5.24 

65.4 

1123 

14.0 

14.8 

6.30 

78.7 

1439 

18.0 

13.4 

7.40 

92.5 

2007 

25.1 

11.7 

• 

3.29 

32.0 

157 

1.6 

64.5 

3.66 

36.6 

386 

3.9 

30.0 

4.25 

42.5 

452 

4.5 

29.8 

100 

4.88 

48.8 

829 

8.3 

18.9 

6.11 

61.1  . 

1303 

13.0 

14.9 

7.12 

71.2 

1597 

16.0 

14.1 

7.30 

73.0 

1719 

17.2 

13.5 

7.44 

74.4 

1924 

19.2 

12.3 

7.54 

75.4 

2014 

20.1 

11.9 

7.59 

75.9  1 

2166 

21.7 

11.1 

7.79 

77.9 

2370 

23.7 

10.4 
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Figure  3.7  shows  regions  various  output  levels  as  a 
function  of  number  of  nodes  and  cost  per  node.  Figures  3.6  and 
3.7  clearly  indicate  trends  In  network  performance  and  economy. 

At  low  throughputs  (3000  bps  or  less),  within  the  range  of  the 
sizes  considered^  the  larger  networks  are  more  economical  than 
the  smaller  networks.  This  is  because  there  is  a  minimum  cost 
required  to  construct  a  two  connected  network,  independent  of 
throughput.  The  minimum  cost  networks  for  20  and  40 'node  systems 
result  in  throughputs  of  approximately  3000  bps  and  so  if  less 
than  that  throughput  is  required,  the  full  cost  is  still  applicable. 
The  larger  networks  introduce  economies  of  scale  which  allow  more 
efficient  sharing  of  capacity.  Thus  a  throughput  per  node  of,  say, 
1500  bps  per  node  can  be  obtained  more  economically  for  a  100  node 
network  than  for  a  40  node  network. 

At  intermediate  and  moderately  high  output  levels  (5000-350QO  hps 
per  node) ,  the  larger  networks  ajj^ar  to  be  nearly  as  economical  as  the 
smaller  networks.  However,  since  any  network  would  require  cer¬ 
tain  overall  fixed  projeot  and  management  costs,  operating  with  a 
la^er  number  of  nodes  would  reduce  the  total  cost  per  node  for 
the  system. 

At  very  high  output  levels,  (18000  bps  and  above)  the  larger 
networks  seem  to  be  somewhat  less  efficient  than  the  smaller  ones. 
There  are  several  possible  reasons  for  this.  For  example,  the 
0.5  second  average  time  delay  constraint  becomes  more  difficult 
to  meet  with  low  capacity  lines.  capacity  230  XB  lines 
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are  very  uneconomical  when  compared  to  50  KB  lines.  (For  example, 
a  2500  mile  230  KB  line  costs  more  than  five  50  KB  lines.)  The 
IMP  configuration  allows  only  five  or  six  output  lines,  and  con¬ 
sequently  the  designs  are  forced  to  contain  a  number  of  costly 
230  KB  lines  rather  than  more  economical  combinations.  Finally, 
the  present  line  and  IMP  options  do  not  allow  very  high  rate  (400 
KB  or  more)  low  cost  lines  that  are  presently  being  developed. 

Such  lines  (and  IMF's  capable  of  handling  the  required  data  rates) 
would  introduce  substantial  economies  of  scale. 

In  summary,  using  equipment  designed  for  essentially  low  or 
intermediate  rate  traffic,  the  latrger  networks  can  provide  service 
at  least  as  economically  as  the  smaller  ones,  except  at  very  high 
throughputs.  The  decreases  in  efficiezicy  at  higher  throughputs 
seem  to  be  caused  by  the  limitations  of  the  equipment  used  in 
the  designs.  If  more  suitable  equipment,  which  is  either  avail¬ 
able  ncv  or  \mder  development,  is  utilized  in  the  designs,  large 
networks  should  be  more  economical  them  the  smaller  ones.  The 
precise  tradeoffs  that  occur  in  such  cases  will  be  the  subject 
of  continuing  study  by  the  Network  Analysis  Corporation. 
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are  described  and  the  results  of  a  study  to  derive  estimates  of 
optimum  performance  for  specified  networks  are  discussed.  The 
tradeoffs  between  cost  and  throu^put  as  a  function  of  the  nundMr 
of  nodes  in  the  network  are  displayed,  and  the  substantial  cost 
advantages  of  large  oasputer-cessiunioatien  networks  dssMNistrated.o 
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